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chapters. These items have been chosen for practical application or 
theoretical significance to the evaluation of program design and 
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PREFACE 



The conferences and institutes dimension of higher adult education 
is now well, established in North American institutions and is 
still rapidly expanding. The C & I staff is increasingly gaining 
in professional expertise in program planning and management, as 
well in general administration. The evaluation of program 
design and especially of the learning process, however, is still 
lagging behind in sophistication. Search of the literature for 
items pertaining to evaluation withi.n the C & I framework only 
underscores this deficiency. The C & I Division Research 
Committee has compiled this annotated bibliography on ev6^.uation 
in an attempt to assist especially the relative novice in C & I 
work in his search for increased proficiency in evaluating his 
programs. We trust that it will prove to be of some asslstsuice 
also to the more experienced colleagues. 



Criteria used in item selection: | 

1. The bibliography should consist of items relating to ' 

(a) Evaluation of program design and content 

(b) Evaluation of learning within a program 

2. The bibliography should contain annotated entries for books, 
chapters in books, and articles in periodicals which have a 
direct and practical application or theoretical significance 

relating to evaluation within the scope of C & I activities. | 

3. An appendix should contain samples of appropriate evaluation 
instruments. 
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PART I: THEORY AMD TECHNIQUES OF EVALUATION 



1. Bloom, Benjamin S. (ed.). TAXONOMY OF EDUCATIONAL OBJECTIVES. Ifondbook I; 
COGNITIVE DOMAIN. New York: Longmans, Green & Co., 1956* 



’’This Handbook of the Taxonomy presents a hierarchiced classification 
scheme which defines and orders cognitive educational objectives which 
emphasize the recall or recognition of knowledge and the development 
cj Intellectual abilities and skills. The continuum has six levels, 
which are, from lowest to highest; (l) IC nowledge , which includes remem- 
bering terminology, facts, trends 8uid sequences, principles €Uid general- 
izations, and theories and structures j (2) Comprehension (the lowest 
level of understanding) , which includes translation from one form of 
communication to another, interpretation of a conmiunication, and extra- 
polation; (3) Application » the use of abstractions in concrete situations; 
(4) Analysis of a communication's elements, relationships, and prganiz- 
atlonal principles; (^) Synthesis , such as producing a unique communica- 
tion or a plan; and (6) Evaluation a or Judgments, in terms of internal 
evidence and external criteria, about the value of material and methods 
for given purposes. 



This Taxonom: / should help planners to specify objectives so that it 
becomes easier to plan learning experiences and prepare evaluation 
devices. Conference planners should also find it useful as a framework 
for thinking about program objectives." 

Source: Annotated Bibliography on Residentietl Adult Education . Item No. 6 
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Krathwohl, David R., Benjamin S. Bloom, and Bertram B. Masia. TAXDNMY OF 
EDUCATIONAL OBJECTIVES. Handbook II: AFFECTIVE DOMAIN. New York: 

David McKay Co., 1964. 



"This Handbook of the Taxonomy presents a hierarchical classification 
scheme which defines and orders affective educational objectives which 
emphasize a feeling tone, an emotion, or a degree of acceptance or 
rejection. These are commonly expressed as interests, attitudes, appreci- 
ations, values, and emotional sets or biases. The continuum has five 
levels, which are, from lowest to highest: (l) Receiving , which includes 

awareness, willingness to notice something, and controlling attention; 

(2) Responding j including compliance, willingness to respond, and satis- 
faction in responding; (3) Valuing » which includes acceptance of, 
preference for, and committment to a value; (4) Organization , which 
Includes conceptualization of a value, cmd organization of a value system; 
and (5) Characterization by a value or value complex (one's view of the 
universe or one's philosophy of life). 



This Taxonomy should help planners to specify objectives so that it 
becomes easier to plan learning experiences and prepare evaluation devices. 
Conference plsuiners should also find it useful as a framework for think- 
ing about program objectives." 



Source; Annotated Bibliography on Residential Adult Education . Item No. 27 
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3. Byrn, Darcie, ed. EVALUATION IN EXTENSION. Division of Extension Research 
and Training, Federal Extension Service, United States Department of 
Agriculture, I 962 . 107 PP* 

”The purpose of evaluation in Extension is to help obtain and interpret 
facts. The authors have written this manual to aid workers in the 
Cooperative Extension Service of the United States to be better’ able to 
understeuid and apply the principles and methods of evaluation. Examples 
are drawn from and the applications are made to the Cooperative 
Extension Service, but principles and methods discussed have application 
to extension -type education in other parts of the world and to other 
kinds of informal education. Extension evaluation means the use of the 
scientific approach in providing facts as a basis for making decisions, 
drawing conclusions, or forming Judgements about the organization and 
. conduct of extension work.” (Foreword) The manual covers: Evaluation 
— What It Is?; Evaluation in Extension Education; The Place of BvcULuation 
in Extension; The Scientific Approach and Extension Evaluation; Goals 
and Objectives; The Place of Teaching Plan Analysis in the Evaluation 
Process; Evidence of Progress Toward Objectives; Identifying Problem 
Areas and Stu(5i’’ Objectives; Sources of Data; Sampling; Methods of 
Collecting Data; Interviewing; Devices for Collecting 'Data; Construction 
of an Evaluation Device; Tabulation; Analysis and Interpretation; 

Preparing a Research or Study Report; Applying the Results of Evaluation 
in Extension; Understanding and Using Evaluation Reports; In Conclusion. 

An excellent manual on evaluation. 



4. Committee on Evaluation. PROGRAM EVALUATION IN ADULT EDUCATION, Chicago; 

Adult Education Association, 19^2. 32 pp. 

The scope and rationale of the brochure can be seen from the following 
excerpt from the introductory statement: "Evaluation is the process of 

assessing the degree to which one is achieving his objectives. It is 
looking at one's present position in regard to one's goal. It is a 
comparison of the actual with the ideal. ... In adult education, as in 
most fields dealing with human behaviour, evaluation is a relatively 
complex process which may start with assessing changes in Individuals 
or with determining the effectiveness of the total program. This pamphlet 
is concerned primarily with the latter aspect program evaluation; it 
deals with ways of assessing individual growth only Incidentally, and 
only Insofar as they throw light on progress of the whole program. The 
concern here is not evaluation of growth of individuals within an adult 
education prograid so much as it is evaluation of adult education programs 
themselves.” This is one of the first manuals of systematic evaluation 
in adult education. 
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5. Durston, Berry H. ’’THE EVALUATION PROCESS IN ADULT EDUCATION," JOURNAL 
OF THE INTERNATIONAL CONCaffiSS OF UNIVERSITY ADULT EDUCATION, 7 : l 4 - 25 , 

(Sept., 1968). 

The opening pe.r€igraph of this useful review of recent literature on 
evaluation in adult education defines the content of the article: 
"Evaluation in adult education is the process of determining the extent 
to which the objectives of a particular educational programme have been 
achieve*’. In other words, if education aims to produce growth and 
change in people (in their knowledge, skills, attitudes, behaviour), 
evaluation in education aims to assess the extent of this growth and 
change which is the outcome of peurticular educational experiences." 
Topics covered in the review: Is evaluation worthwhile; procedures for 

evaluation; some considerations in evaluation; what to evaluate; sources 
and characteristics of programme objectives; gathering the evidence; 
processing the evidence; and some evaluation models. 



6 . Eidell, Terry L. and John A. Klebe. ANNOTATED BIBLIOGRAPHY ON THE EVALUATION 
OF EDUCATIONAL PROGRAMS. Oregon University, Eugene: ERIC Clearinghouse on 

Educationa] Administration, I968, 19 pp« 

"Sixty -four books pamphlets, papers and journal articles published, for 
the most part, between 1964 and 1968 are listed in this annotated 
bibliography on the evaluation of educational programs on the elementary, 
secondary, and higher education levels. Topics covered include the 
evaluation of school subject programs, vocational programs. State aid 
programs, curriculum, educational planning. Federal programs, teaching 
quality, educational change and educational outcomes and quality. Some 
entries pertain to the development and use of mathematical models and 
cost -benefit analysis for evaluative purposes. Emphasis is on the methods 
procedures, models, and exenq)lars of educational program evaluation." (TT) 

Source: Research in Education, =/fED 025 857 



7. Glaser, Robert. EVALUATION OP INSTRUCTION AND CHANGING EDUCATIONAL MODELS 
(Occasional Report No. 13), Los Angeles: Center for the Study of 

Bviduction of Instructional Programs, University of California, I968. 27 pp. 

The author presents a thesis that changing educational practices require 
changes in theories and techniques of evaluation. He presents a general 
model of an emerging instructional process encompassing six educational 
practices (specification of learning outcomes; diagnosis of entry 
behaviour; design of instructional alternatives; continuous assessment; 
adaptation and optimization; and evolutionary operation) and suggests 
considerations for evaluation and measurement raised by each of these 
practices. 



8. Guba, Egon G. EVALUATION AND CHANGE IN EDUCATION. Paper prepared for the 
Elk Grove Training and Development Center Spring Evaluation Conference 
(Arlington Heights, 111., May l6, 1968). 46 pp. 

"Evaluation, defined as the process of providing and using information 
for making educational decisions, is a major factor in the achievement 
of planned change resulting in improved education. This kind of change 
is differentiated as neoraobilistic or moving toward a planned new state, 
in contrast to evolutionary change and homeostatic change. Four 
distinct evaluations -- of context, input, process and product -- are 
necessary in the neomobilistic change process. To perform the full 
range of evaluation tasks competently, a minimum of of six specializ- 
ations or evaluator roles is required — interpreter, instrument 
specialist, data processor, information specialist, reporter, and data 
collector. Six steps outline the procedure for designing an evaluation 
of each stage of the process. Ten criteria describe the requirements 
that must be met by evaluative information." (jk) 

Source: Research in Education # ED 027 60I 



9. Knox, Alan B, "CONFERENCE OBJECTIVES: PRELUDE TO EQUATION", ADULT 

LEADERSHIP, 10: 234-236, 248, (February, I962). 

The article presents a clear and concise statement of the need for and 
the process of establishing objectives as a necessary and integral step 
of determining evaluation processes during and after the conference. 

The following types of objectives and their relevance to evaluation 
are discussed: (l) non -educational, (2) societal, (3) group, 

(4) instructional, and (5) student. Categories of change sought are 
classified as (l) interest, (2) skill, (3) knovrledge, (4) understanding 
of relationships, and (5) critical thinking. The author points out the 
inteY-relationship between statement of objectives, change desired and 
evaluation: "At least one of the values should be that the objectives 

might serve as standards against which to determine the degree to 
which the conference program did in fact move the participants from 
where ihey were towards the objectives." 
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10. Mann, David K. , Raymond E. Carter and Carl E. Larson. PROCRAM EVALUATION 
IN INSTITUTES AND CONFERENCES. Lawrence, Kansas; The University of 
Kansas Press, I963. 

"This is the handbook needed by anyone who plans to evaluate an 
institute or conference. It not only lists suggested steps in an 
evaluation, but it also identifies educational objectives and outlines 
development of evaluative devices; in other words, it gives the philo- 
sophical background behind its outline of action. The handbook is 
based primarily on a pilot study of The Midwest Management Institute 
for Credit Bureau and Collection Service Managers, begun in the fall 
of 1961. This institute was chosen because it fitted stuc3y needs. 

Result was a precise evaluation method, study-tempered and shaped. The 
author admits that the evaluation guides that resulted are just that 
-- guides. It may not be either necessary or possible to use them an 
at all times. Evaluation may be as simple or as complex as the 
situation requires, but, he conc3.udes, 'the essential requisite for 
effective evaluation ... is precise and accurate clarification of goals 
and objectives. This step is often taken for granted in conducting 
an event. It should no t be.' An appendix shows the actual evaluation 
forms used in the studyT^’ 

Source; Annotated Bibliography on Residential Adult Educati on. Item No. 35 j 



11. Miller, Harry I-,, and Christine H. McGuire. EVALUATING LIBERAL ADULT EDUCATION, 
Chicago; Center for the Study of Liberal Education for Adults, I961, l84 pp. 

This research report is of considerable significance in the development 
of scientific evaluation of the difficult area of liberal adult education. 
Reporting on an evaluation project undertaken by the Center, the authors 
present practical framework for evaluation of programs in the po3.itical 
and social area, the community participation a'x^ea, the moral and ethical 
area, and the area of the arts. Know3.edge objectives for each of these 
areas are specified, other possible objectives are suggested, and a 
series of preliminary drafts of evaluation instruments is given. The 
overview includes discussion of the evaluation process, defining objec- 
tives, developing instruments, developing effective teaching procedures I 

(to achieve stated objectives), and evaluation procedures. 



12. Miller, K. M. "EVALUATION IN ADULT EDUCATION," INTERNATION/.X SOCIAL SCIENCE 
BULLETIN, 7: 430-442 (1955). 

The article presents a brief overview of the need and the techniques of 
evaluation in adult education. Topics covered are; (.1) criteria of 
evaluvition, (2) methods and techniques for gathering data, and (3) 
illustrative studies. A table of method, procedure, instrument and 
Indices classification is included. A practical introduction for the 
novice . 
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13. Sutton, Elizabeth W. ANALYSIS OF EESEARCH ON SELECTED ASPECTS OF EVALUATION 
IN ADULT EDUCATION. Florida State University, Tallahassee, 1966. USOE 
Cooperative Research Program. CRP-5 -449-64. 31 pp. 

’’This bibliography begins with general references in adult education 
reseaich. Part ll. Evaluation research, eraphaslzes programs in agri- 
culture and home management offered through cooperative extension and 
is divided into — 1) Behavioral change, 2) Effectiveness of methods 
(tv, radio, meetings), and 3) Adoption-diffusion process. Other 
sections of the bibliography are on university extension, evening 
colleges, junior or community colleges, public school adxilt education, 
and Great Books." (aj) 

Source; ’’Research and Investigations in Adult Education," Adult Education, 

17: 258 (Summer, 1967) ” 



l4. Thiede, Wilson. "EV/JliUATION AND ADULT EDUCATION" in ADULT EDUCATION, 

OUTLINES 0F AN EMERGICNG FIELD OF UNIVERSITY STUDY, edited by Gale Jensen, 
A, A, Liveright, and Wilbur Hallenbeck, Chicago; Adult Education 
Association of the U.S.A., 1964 (Chapter XV, pp. 29I-305). 

’’This chapter has attempted to show the need for increased eiuphasis 
on evaluation in adult education. Evaluation is defineu as the process 
of determining the extent to which educational objectives have been 
attained. Purposes of evaluation may be subsumed under the following 
four; 1. guiding individual growth and development; 2, improving 
programs; 3. defending programs; and 4. facilitating and encouraging 
staff growth and development. There are important and useful inter- 
relationships between educational objectives, learning experiences, 
and evaluation procedures. 

There are five steps in the evaluative process: 1. determining what to 

evaluate, 2, defining the behavior desired, 3. determining acceptable 
evidence, 4. collecting evidence, and 5» summarizing and evaluating 
the evidence." (Summary) 


















15. Tyler, Ralph W. , Robert M. Gagne, Michael Scriven. PERSPECTIVES OF 
CURRICULU'l EVALUATION, Chicago: Rand McNally & Co., 1967* 102 pp. 




The three main papers in this monograph are a valuable contribution to 
the theory and practice of educational evaluation. Although concerned 
primarily with curriculum evaluation, the papers are of considerable 
interest to the adult education administrator or program planner. The 
paper by Scriven on the methodology of evaluation in particular is of 
interest. Topics covered by this paper are: (l) Goals of evaluation 

versus roles of evaluation, (2) professional versus amateur evaluation, 
(3) evaluation studies versus process studies, (4) evaluation versus 
estimation of goal achievement, (5) "intrinsic" evaluation versus "pay- 
off" evaluation, (6) practical procedures for mediated evaluation, 

(7) possibility of pure "pay-off" evaluation, (8) comparative versus 
non-comparative evaluation, (9) practical procedures for control -group 
evaluation, (10) criteria of educational achievement for evaluation 
studies, (11) values and costs, and (12) "explanatory evaluation". 

The monograph contains an extensive bibliography. 



16. Verner, Coolie. "EVALUATING THE ACTIVITY" in Coolie Verner and Alan Booth, 
ADULT EDUCATION, Washington: The Center for Applied Research in Education, 

Inc., 1964. (Chapter VI, pp. 91-105) 

A concise overview of the rationale, process and uses of evaluation 
of educational programs. Topics discussed: Why evaluate; Approaches 

to Evaluation (Program Evaluation; Participant Evaluation) ; the 
Problem of Evaluation; the Evaluation Process (identification of goals; 
Selection of procedures); Areas of Measurement (Knowledge or informa- 
tion measurement; attitude measureiaent ; skill measurement; acceptance 
and adoption measurement) ; Constructing Instruments; Making the 
Measurements; Utilizing the Results. 
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PART II: EVALUATING PROGRAM DESIC2J AND CONTENT 



17. Annas, Philip A. et.al . GUIDE TO ASSESSMENT AND EVALUATION PROCEDURES, 
THE NEW ENGLAND EDUCATIONAL PROJECT. I966, 37 PP- 

"The recent prol Deration of federal support programs in education 
has brought an increased demand for carefully planned, formal 
evaluation at both the state and local levels. In order to aid local 
school systems in the complex work of evaluation of title I and other 
special education projects, this guide has been prepared. It presents 
in workbook form a step-by-step process of evaluating a project. A 
glossary of terms and bibliography are al ^ included." (NS) 

Source: Research in Education, # ED 012 087 











18. Densmore, Max L. "AN EVALUATIVE ANALYSIS OF SELECTED UNIVERSITY CONFER- 
ENCE PROGRAMS CONDUCTED AT KELLOGG CENTER FOR CONTINUING EDUCATION 
MICHIGAN STATE UNIVERSITY" Ph.D. Thesis, Michigan State University, 

East Lansing, I965. 191 PP* 

"An analysis of residential continuing education programs conducted by 
TJniversit-v Conference Services at Michigan State University's Kellogg 
Center f Continuing Education was conducted in order to develop an 
instrument and methodology with universal application to measure con- 
ference success and participant satisfaction. Data were gathered from 
630 respondents attending ten conferences, who were classified by 
Bureau of the Census industrial areas of origin, occupational level, 
and sex. Participant's perception of their learning and the relation- 
ship to overall satisfaction with the conference experience were 
analyzed. The Kropp Verner Reaction Scale was extensively used in 
measuring conference success and overall satisfaction. It was found 
that women favoured conferences more than men; a significant difference 
existed between participant reactions when classified by industry of 
employment; program satisfaction was rated differently depending upon 
occupational level; and a mutual relationship existed between how 
participants Judged the quality of their learning experience and degree 
of total satisfaction. Numerical indexes of participant satisfaction 
and conference success were developed for each conference analyzed." 
(author/pt) 

Source: Research in Education, # ED 025 707 
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19 . Kropp, Russea.1 P. and Coolie Verner. "AN ATTITUDE SCALE TECHNIQUE FOR 

EVALUATING MEETINGS" ADULT EDUCATION, vol. 7, No. 4, (Summer, 1957), ^ 

pp. 212 - 215 . 

The authors have devised an attitude scale as an instrument to measure 
general attitude of the total group of participants at the conclusion 
of an organized educational experience of a one or two days duration. 

In creating this attitude scale the basic method for scale construc- 
tion developed by Thur stone and Chave was used. The method of prepar- 
ing the items was that used by Reramers in adapting the Thurstone 
technique so that 'attitudes in general' could be measured. The 
scale will provide an assessment of the activity in terms of the 
attitudes of the participants. In addition to measuring the overall 
reaction to the program the scale can be used also within the program 
to measure and compare participant satisfaction of one type of process 
against another. The instrument is simple to administer and interpret. 

Scoring the instrument is simplified by constructing a scoring key 
which contains a median value for each of the items so that the items 
on the key and on the scale can be matched. From this key the scorer 
can read the value of each item that has been checked on the scale. 

( The scale is included in the Appendix of this bibliography) . 



20. McGuire, Christine H. AN EVALUATION MODEL FOR PROFESSIONAL EDUCATION — 
MEDICAL EDUCATION. Paper presented at Invitational Conference on Testing 
I Problems, New York, N. Y. , October 28, I 967 . Published in Proceedings 

I of the Conference, pp. 37-52. 

I "There are striking similarities between medical education of today 

[ and progressive education of the thirties with respect to motivation 

[ for change, the values to be thought in change, and the zest with 

I which change is pursued. It is in this climate conducive to change 

that a new ai^proach to evaluation is beginning to make a significant 
contribution to the systematic modification of medical education. 

Three case descriptions are presented to illustrate some of the ways 
evaluation is being incorporated. The first, discussed more fully 
* than the other 2, is an institutional mechanism for systematic data 

i collection and regu3.ar multi -channel feedback that has been established 

I by the facility of the University of Illinois College of Medicine. The 

second is a research study of certifying procedures used in assessing 
professional competence in medical education. The third represents 
i a general schema for ongoing institutional self-study that has been 

made operational to varying degrees in a number of institutions." (JS) 

Source: Research in Education , # ED 028 699 
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21. Trickett, Wilson L. "AN EMPIRICAL INVESTIGATION OP THE EFFECTIVENESS OF 
EXECUTIVE DEVELOPMENT PROGPA.'4S AS PERCEIVED BY PARTICIPATING MARKETING AND 
SALES EXECUTIVES*’ Michigan State University, East Lansing, Mich., 19^7 
Ph.D. Thesis. 122 pp. 

II ^ 

! A study of the effectiveness of executive development programs for 

I marketing and sales executives tested three hypotheses: (l) partici- 

pation in such programs results in identifiable benefits as perceived 
by the participants; (2) academically oriented executive development 
I programs have significant advantages over company oriented programs as 

I perceived by participants; and (3) program benefits as seen by partici- 

pants are enduring. Phases of the study were an evaluation of a 2|- 
week Graduate School of Sales Management and Marketing (I962), a 
questionnaire survey of 84 management and marketing executives (1964), 

I and a follow-up evaluation in I965 of the effectiveness of the programs. 1 

I The hypotheses were basically substantiated. However, there was 1 

relatively little enthusiasm for company programs as compared to 
I academically oriented programs. Three major features of the more , 

' successful programs were: (l) participant had both the desire and the 

capacity to develop; (2) the best qualified instructors were university | 

faculty with a business or business consulting background; (3) the ' 

curriculum fitted executives' daily employment needs, used the best i 

learning techniques, and involved discussion among participants and m 

with faculty." (author/ly) 1 

Source: Research in Education. # ED 028 399 i 



[ 22. Welden, J. Eugene. PROGRAM PLANNING AND PROGRAM EFFECTIVENESS IN UNIVERSITY 

RESIDENTIAL CENTERS. Unpublished Ph.D. dissertation. Chicago: Department 

of Education, University of Chicago, 1966. 

i "The purpose of the study (was) to examine the relationship between 

■ conferences planned without participant representation €tnd conferences 

planned with participant representation on three measures of program 
effectiveness: (a) participants' relation of program to personal 

motives; (b) participants' expressed satisfaction with total program; 

I and (c) participants' expressed interest in continuing educative 

^ activity." (p.3)* This study was concerned principally with affective 

components of educational objectives as differentiated from cognitive 
I components. 

* A five-part 'Conference Evaluation' form wa»j administered to 1,026 men 

and women who attended 47 different conferences at five university 
residential centers. The evaluation form consisted of a 'Satisfaction 
Index, 'a section on 'goal directed behaviors, 'a 'Personal Motives 
Indexi' and 'Interest Inventory' on educative activities, and several 
demographic items." 

Source: Annotated Bibliography on Residential Adult Education . Item No. 49 
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PART III: EVALUATING LEARNING 



23. Blanf»y, John P. and Douglas McKie. "KNOWLEDGE OF CONFERENCE OBJECTIVES 
AND EFFECT UPON LEARNING," ADULT EDUCATION, 19: 98-105 (Winter, I969). 

ABSTRACT: 

To determine whether knowledge of instructional objectives in an 
adult education program assists the participants to attain these 
objectives, randomly arranged groups of conference attendees were 
given three treatments: immediately prior to the conference, group 

A was provided with the instructional objectives in behavioral form; 
group B with a general orientation to the program; and group C with 
a pretest (in order to determine whether there was a change in the 
behavior under consideration during the conference) . Upon the con- 
clusion of the conference, all groups were given a posttest. The 
hypothesis that the group that was given behaviorally stated objectives 
would do significantly better on the criterion test than group B was 
upheld at the .05 significance level. Additional hypotheses are 
suggested concerning ways in which adult educators may usefully employ 
behavioral objectives in program planning and administration. 



24. Brownell, William A. "THE EVALUATION OF LEARNING UNDER DIFFERING SYSTEl'48 

OF INSTRUCTION," EDUCATIONAL PSYCHOLOGIST, vol. 3, No. 1, (November, I965). 

"An insightful discussion of the evaluation of learning under differ- 
ent kinds of instruction. His discussion covers the complexity of 
evaluative research; the need for judgement by the experimenter; and 
the 'common sense’ evaluation of findings of statistical significance." 

Source: Wientge & Lahr: The Influence of Social Climate on Adult Achievement, 

p. 25. 



i 



25. Giuliani, Betty. EVALUATION SUMMARY FOR 12TH ANNUAL SEMINAR FOR COLLEGE p 

AND UNIVERSITY LEADERS IN CONTINUING EDUCATION. East Lansing: Michigan jj 

State University, 19^9 . 48 pp. and appendices. |i 

"The evaluation procedures developed for the I969 Seminar were ji 

intended to serve several purposes: 1) to focus participant thought y 

on the issues of the Seminar, 2) to elicit participant opinion on | 

the issues, 3) to feed that opinion back into the consultation 
sessions, and 4) to provide information on what, if any, changes J 

occurred in the thinking and opinions of Seminar participants during ; 

their four days at Kellogg Center." (introduction) The tac'miqiios j 

used are discussed and the evaluation results are analyzed in the j 

summary. The appendices contain samples of all instruments used. ll 
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26. Gordon, George K. A Q-SORT INSTRUMENT FOR MEASURING ATTITUDES TOWARD THE 
SEVEN EDUCATIONAL CONDITIONS OF THE INDIANA PLAN. Ed.D. dissertation, 

Indiana University, 1965 . 

‘ 4 * 

The purpose of the study was to construct, validate and test a Q-sort j 

instnament for measuring attitude changes of individual participants 
toward the seven educational conditions of the Indiana Plan during the 
course of training in an adult education institute. When Q-sort arrays 
were inter cor related and factor analyzed, two discriminating factors 
were extracted. These were identified as representing a democratic 
attitude and an authoritarian attitude. Participation in the Institute ] 

did coincide with significant changes in the factor loadings of the 
Institute participants. The Q-sort did measure attitudes. The criterion 
subjects did share a common pattern of attitudes. Participation in the 
Institute did coincide with significant changes of attitudes. The 
meaning of the changes cannot be interpreted without further studies. < 

Q-procedure does provide a meeucis of studying the phenomena of intra- 
personal change. 

Adopted from: "Research euid Investigations in Adult Educediion," | 

Adult Education I6: 212 , (Summer, I966). j 

' 



27 . Johnson, Raymond L. et.al . MEASURING THE EDUCATIONAL RELEVANCE OP A SHORT- ^ 

TERM TRAINING PROGRAM FOR TEACHERS. Paper presented at the National I 

Seminar on Adult Education Research, Toronto, Feb. 9-Hj 19 ^ 9 * 17 PP* j 

1 

"A multiple time series design was used to test the effectiveness of 
short workshops for housewives recruited to teach basic reading to 
adults in bringing about changes in teacher attitudes and opinions. 

An attitude and opinion survey questionnaire comprising true-false 
items was given on three occasions, to all participants in a nine- 
hour workshop. All the participants answered the questionnaires at 
the beginning of the workshop but only the members of the experimental ' 

groip answered them the second time after teaching a class. Sixteen 
of the 100 items showed significant shifts in responses between times 
one and two for the experimental group and fourteen for the control | 

group, and virtually all the changes induced in the controls persisted ‘ 

time three. Hbwever, the effects of the workshop were almost 
totally erased by the experiences in the classroom. (An appendix with 
an outline of the procedure is included.)" (nl) 

Source: Research in Education, # ED 025 723 j 
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28. Lacognata, A. A. A COMPARISON OF THE EFFECTIVENESS OF ADULT RESIDENTIAL 
AND NON-RESIDENTIAL LEARNING SITUATIONS. Chicago; The Center for the 
Study of Liberal Education for Adults, 1^6l. 

"This was the pioneer empirical comparison of the two types of situations 
mentioned in the title. When the Center learned of two similar insurance 
courses to be held simultaneously, by the same instructor, for the same 
time, with the same objectives, it asked the author to make the study. 

He compares an eight -day residential course with 6o participants, living 
at the Michigan State Kellogg Center for Continuing Education, with 
another eight -day non-resident ial course for 7^ participants in Detroit. 
He devised three methods of comparing achievement; an essay-type <3.uizj 
measures of knowledge applicationj and state insurance test results to 
measure combined knowledge acquisition and application. He tested the 
central hypothesis that residential instruction results in superior 
achievement. He concludes that ’the research tends to support the 
hypothesized superiority of residential instruction. ' This may be due 
to combined isolation, continuity, and group influences. However, the 
author also admits that ’perhaps more problems were uncovered than 
resolved,’ and he ends by suggesting further research to clarify at 
least four problems, which he lists. The work and this report are 
invaluable to anyone in the field or planning further research in it." 

Source; Annotated Bibliography on Residential Adult Education . Item No. 29- 



29 . Wientge, King M. and James K. Lahr. THE INFLUENCE OF SOCIAL CLIMATE ON 

ADULT ACHIEVE14ENT — THE IMPACT OF A RESIDENTIAL EXPERIENCE ON LEARNING AND 
ATTITUDE CHANGE OF ADULT STUDENTS ENROLLED IN AN EVENING CREDIT CLASS. 
(University College Research publications No. lO) University College, 
Washington University, St. Louis I 966 29 pp. 

"A comparison was made of the amount of learning in an adult evening 
class on cair^us with that of an experimental class which attended 
sessions on campus and spent two weekends at a university residential 
center. It was expected that the experimental class would learn more 
and experience positive changes in attitude compared with the control 
class. The same instructors were used for both groups a In order to 
control method of instruction as a variable, the lecture-discussion 
method was used in both groups. Pretests of intelligence, attitudes, 
and subject knowledge were given to all, and attitude and subject 
knowledge tests were repeated at the end of the term. The experimental 
group also completed a final evaluation questionnaire. The experi- 
mental group was significantly more intelligent, but no significant 
differences showed up in either the pre-test or post-test of attitudes 
or subject knowledge . The experimental group enjoyed the social setting 
at the residential center but did not feel more learning occurred there. 
Rather, the periods between sessions were seen as deterrent to learning." 

Source; Research in Education # ED Oil 371 
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SAMPLBS OF EVALUATION INSTRUMENTS 



SW'IIli\RY REPORT 



UORKSHOF ON EVALUATION 
NUBA ConPercnce and Institute Division 

Santa Barbara, California 




PREFACE 

On May 5, 6, and 7, 1961 the C. & 1. Division conducted a Prc-NUEA Con- 
ventlon Itorkshop at Santa Barbara, California on the general subject of evalua- 
tion of conference and institute programs. This program is one phase in the 
five year sequence of self -development activities inaugurated for Ce & I. 

Division personnel. This plan was adopted by the Division's Executive Conalttee 

last March In Chicago. 

The leaders for this Workshop program were Mrs. Jane Zahn of the University 
of California Extension Division and Mrs. Christine Massenoan of the C.S.L.E.A. 
staff and the University of Chicago Examiner's office. The C.&l. Division is 
deeply Indebted to them for the outstanding leadership they gave to this work- 
shop. 

The Division also wishes to acknowledge the invaluable part played by the 
Center and Its stiff In making this workshop possible. Mr. Peter Selgle was 
particularly Instrumental In assisting the Division In planning and staffing 
the Workshop. 

INTRODUCTION 

The report that followb Is drawn from the hand inrltten notes of the Work- 
shop Chairman; and, of necessity. It Is limited to a few salient and Important 
points that were discussed In the Workshop. Since there ms no tape recording 
of the workshop sessions. It is Impossible to report accurately on the many 
observations and comments that would give one a detailed and accurate 
latlon of the Workshop. There Is no adequate substitute for actual participation 
In a workshop of this sort, and this report Is only an Inadequate reflection 
of idiat transpired during the 2 days of the workshop sessions. 

PURPOSE OP WORKSHOP 

A two-fold purpose lay behind the design of this workshop: 1. To develop 

a practical understanding of some of the important theory and principles of 
educational evaluation - with particular reference to conference and Institute 
programs. 2. To give participants come practical experience In employing 
evaUiatlon principles to an actual conference and Institute situation. 

Workshop Schedule 



May 6 - 9:00 A.M. 

Introduction to the Workshop - Alan Brown 

Workshop Chairman 

"Identifying and Categorizing the Educational 
Elements In a Conference or Short Course." 
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Leader - Jane Zahn 

University of California 

2:00 P.M . 

'‘Principles of Evaluation.'' 

Christine McGuire Massenaan 
University of Chicago 

7:30 P.ll . Small group sessions 

• for 

Designing a Plan for Evaluating This Workshop 




May 7 1:30 P.M . 

i "Evaluating the Group's Design." 

Jane Zahn and Christine Masserraan 
3:00 P.M.« Adjournment 



Topic I 5 Identifying and categorizing the educational elements in a con- 
ference or short course. 

The process of evaluation must begin with a clear understanding of the 
educational elements or objectives of the program. It Is only in the 
perspective of pre-determined educational alms and purposes that a sclentlrlc 
assessment can be made of a program's effectiveness. 

In evaluating any educational program, one begins by asking this 
question: "To whdt extent were the experiences and activities of this 

program fruitful and productive In reaching certain objectives? It is 
paramount that one linderstand clearly idiat the educational objectives are 
prior to any attempt td measure their attainment . 

During the first session of the i/orkshop, the group attempted to 
identify, analyze, and categorize the various educational objectives in- 
herent in any conference or institute program. It became apparent that 
educational objectives or purposes - broadly conceived - have many different 
facets and dlmcnsloiis. The complex character of educational objectives was 
illustrated by the following categories of objectives as these were identi- 
fied by the workshop participants: 

1. Fixed objectives vs. Dynamic objectives. 

A "fixed objective" meaning one with a pre-determined limit 
and a "dynamic objective" being one with no pre-determined 
limit. Training an individual to use a flannel board would 
be a fixed objective while developing one's ability to 
communicate effectively with subordinates would be a 
dynamic objective. 
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2. The substantive or content objective - i.e., vocational, liberal, 
social, political, or personal objectives, 

I 

This classification is often used to distinguish between the 
Iciitds of outcomes and values to be achieved in conference and 
institute procranis. Many programs arc designed to reach 
several of these objectives during a single activity. 

3. Attitude Objectives, Skill Objectives and Cognitive Objectives. 

Under the category of "Attitude Objectives" are stimulating 
interest, inculcating values, and at?akening desires, interests, 

and motives. 

Under the "skills" category are all the various activities 
which one can learn to master - public speaking, problem 
solving, etc. 

Cognitive objectives involve acquiring an understanding of 
concepts, facts and principles. 

4. General Objectives vs. Specific Objectives. 

5. Itamediate vs. Long-range Objectives. 

This distinction having to do vzith time. Some objectives 
are obtained in one program while others mtist be pursued 
over a long period of time. 

TOPIC II: A Theory and Principles of Eva! nation 

The process of evaluation can be conceptualized by this diagram. 



Educational Methods 
Materials and 
Procedures 



Educational 

Objectives 




Evaluative Devices 
and Instruments 



i 



1 . Interaction of A and B - Educational objectives and Evaluati ve; 
devices and instruments . 

Tlie objectives of a program determine the kind of evaluative devices 
and Instruments that are appropriate. The evaluative process also provides 
some Insight into the appropriateness and level of . the educational objectives 

for the program. 
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2 • Interaction of B and C ■ Evaluative devices and instruraents with 
educational methods, materials and procedures * 

The process of evaluation appraises the effectiveness of certain 
methods, materials, and procedures in accomplishing the objectives. 



3 . Interaction of A and C •» Educational objectives and Educational methods , 
materials and procedures . 

Tlie methods employed in a program must be appropriate to the objectives 
and there is a close and intimate relationship betx;ecn methods and 
objectives. Optimum achievement of certain objecti.ves requires the use of 
certain materials and raothods and precludes the use of other methods and 
materials. 

B. The Behavioral Aspects of Evaluation, 

Evaluating the accomplishviient of objectives necessarily involves a 
change in the behavior of the participant . Some useful or valuable thing 
has happened and it is necessary to identify and measure that change in 
some way - direct or indirect* It is necessary, therefore, to contrast or 
measure the ending point behavior with respect to the starting point behavior, 

Tlie strategy of evaluation involves answering three fundamental 
questions: 



o 
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1. How does the individual demonstrate his change or behavior? 

2. In what situations does he demonstrate this change of behavior? 

3. How do we tell that the individual behaves differently? 

By way of illustrating the application of this evaluative technique, a 
typical objective was selected by the group - namely, the objective of 
increasing skills in human relations. In answering question 1 above, the 
individual can demonstrate his acquisxon of this skill by exhibiting his 
Increa^^ed knowledge of the subject, by showing his awareness of certain 
principles, by his ability to apply the principle.*? of human relations, or 
by his change of attitude. 

In answering question 2 above, he can demonstrate his change of 
behavior in actual or practical situations, in case studies or in work 
situations back home. 

In answering question 3, one might ascertain changes in behavior by 
noting that he has had fewer grievances as a supervisor or that people 
report different perceptions of his interaction with other people. 

If we specifically wished to evaluate how well an individual Increased 
his skill in human relations, we would construct a situation in which the 
individual could demonstrate his ability to apply certain principles of 
human relations. In order to determine if the person behaved differently, 
we x^ould x;atch for the following kinds of behavioral manifestations: 

1. Did he recognize which principles were relevant to the 
actual situation* 
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2. Could he apply the principle effectively* ^ ^ ^ 

3. Was he aware of the results or implications of what he did. 

4. Could he see the coitimon elements betv;een two different human 

relations situations. ^ 



A CHART REPRESENTATION OF EVALUATION STRATEGY FOR MEASURING INCREASED SKILL 
IN HUtL^ RELATIONS 



l^at behavioral How is the 

activity is skill 

involved manifested 



In what How to 

situation design a 

situation 



Kno\/ledge (Cognitive) 



Application (Skill) 



Disposition to 

use knowledge (attitude) 



Recognizes principles 
Aware of principles 
Sees principles 
Employs principles 



Observation 
of actual 
situation 






In a life 
situation 
In a concrete , 
case ^ 

In a theoretical 
situation 



Role 

Playing 



Analysis of 
Ur it ten 
Case 



Objective 
response to 
test items. 



C. Applying these principles to a particular case. 

The workshop group was assigned the task of devising a compre- 
hensive range of techniques for measuring the :ef fectiveness of an individual 
in applying a specific principle of human relations. The human relations 
principle selected for this purpose is the one which states that the people 
in an organization affected by a decision: should have a part in making that 
decision. The following methods for evaluation were suggested by the group: 

1. Have an individual explain why the principle is true. 

2. Have an individual teach this principle to the group. 

3. Give the group a task or problem* to solve and ask them what 
steps they would take . 

4. Observe how an individual or group would carry out an assigned 
task in an institute program. 

5. Have the group critique the performance of an assigned task. 

6. Have a report from an actual job situation back home which 
indicates the success with which the individual applied the 
principle. 

7. Present or describe situations where the principle may be applied 
with varying degrees of success and ask the Individual to select 

the most appropriate situation. 
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8. Describe some situations in which this principle would apply. 

9. Describe some situations in which the principle x^ould not apply. 

10. Describe two case situations and ask the individual to explain 

the difference in outcomes. 



A 



TOPIC IV. A Summary Statement of Principles of Evaluation; 



Step 1. Define the educational objectives in terms of their subject 
matter and behavioral dimensions. 



Step 2. Specify the particular ways in which the individual can exhibit 
cognitive or behavioral growth or understanding. This can be done by noting 
both positive responses as well as negative responses to testing stimuli. 



Step 3. Develop situations in wiiich the individual can show how well he 
understands and applies the principles and facts he has learned. 



Step 4. Analyze and appraise the response the individual makes. 



Step 5. Use and report the data obtained by the evaluation. This 
Includes diagnosing the performance of the individual, discovering program 
deficiencies, and determining the extent to which progress or growth has 
been achieved . 



TOPIC V; The Application of the Principles of Evaluation through Designing 
a Plan of Evaluation for this Workshop. 



The entire workshop group was divided into three sub-groups and each 
was assigned the task of designing a plan for evaluating this workshop. It 
Is only possible to present one of the evaluation plans proposed. This plan 
will indicate the variety and range of approaches, techniques, and devices 
that can be employed in designing an evaluation. 



The following objectives were Identified for this evaluation workshop; 



1. To Increase Interest in a concern for evaluating conferences and 
Institutes in terms of educational objectives. 



2. To increase the understanding of educational objectives of con- 
ference and Institute work. 



3. To give participants experience in defining and categorizing 
educational objectives. 



4. To Increase the understanding of general evaluation principles 
which might be used in measuring the extent to which educational objectives 
are achieved. 



5. To increase the ability to apply the evaluation principles to 
conference and institutes more effectively. 



6. To Increase skill in evaluation. 

For objectives "1“ and "2" above, the following activities were suggested: 



1, By asking participants to analyze a typical set of program 
objectives as they are found in a program brochure. Are the objectives 
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stctted clearly and viell defined? I'Jhat specific kinds of behavioral changes 
are expected? Iftiat is the content area included in each objective? In terns 
of the various categories of objectives, hox^; would one classify the objectives 
contained in these program announcements. 




2. By making a study of new program announcements prepared by workshop 
participants to see if the program objectives are more clearly stated and 
defined than in the past and if they are closely and logically related to 
the program activities scheduled in the brochure. In short, has the under- 
standing of the educational objectives been applied? 

3. By asking the individual his o\m judgment of what he learned about 
program objectives. 

4. By observing workshop behavior - the degree of formal and informal 
participation, mental fatigue, attendance and attention at the xrorkshop. 

For Objectives '‘3“, *'4", and "5" above, the following methods were 
suggested: 



1. A depth intervieX ‘7 immediately after the workshop in which these 
questions X70uld be asked: 



a* Can you apply what yovi learned in the x/orkshop in x 7 orking X7ith your 

ox^ conference group? If so* how? If not, xdiy not? 

Give three or four educational objectives from recent programs and 
classify them* according to our several categories. 

c. Did the techniques presented differ from what you are nox7 doing? 



If £:o, how? , ^ ^ U J 

d. In your opinion, were any important ideas in evaluation techniques 

neglected? 

e. IJhat did you expect to gain from this x/orkshop on evaluation? 

f . Were the methods of presentation in the program educationally sound? 



2. Ask the people to devise evaluative measures and techniques for a 
specific program that is described in detail. 



3. Ask people to evaluate this x7orkshop. 

4. Suggest a number of evaluation schemes for a specific program and 
ask the participant to select the most effective. 

5. A follox- 7 -up questionnaire administered 6 months after the x/orkshop 
is over. This questionnaire to include such questions as these: 

a. In what ways have you applied xvhat you learned in this t/orkshop? 

b. Hox 7 X'70uld you categorize the educational objectives listed below: 
(This X70uld be a repeat of question b. answered in the post-xforkshop inter- 

viex7 above) ^ 

c. Do the techniques presented at the xjorkshop differ from \mat you are 

doing? If so, hoX7? . u ^ .lo 

d. In what X7ays can your present evaluative procedures be improveoY 
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Although the methods and devices described above would provide interesting 
and valuable information on the effectiveness of this v/orkshop, the most 
telling and effective means of evaluation would undoubtedly involve a careful 
check as to the number of conference evaluations from this workshop group 
which have embodied the principles discussed in this workshop. Such an 
evaluation scheme would be extremely difficult to carry out, but it would 
be the only accuxrate measure of the true effectiveness of the workshop. 



TOPIC VI. Concluding Remarks; 

As one becomes aware of the full implications of vjhat scientific 
evaluation entails, he may feel a little helpless and confused as to what 
it is practical for him to do. Such an attitude should not deter him from 
at least attempting a small scale evaluation of the best sort possible idienever 
he can. 
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One must keep in mind that it is not necessary or realistic to try to 
evaluate completely or exhaustively all aspects of a program. A careful 
selective appraisal of certain features of a program may be quite practical 
and useful. 

The kind of evaluation one carries out for a one-time program may be 
quite different from the kind designed for a continuing or long range 
program. Part of the skill in evaluation is tailoring the design of the 
evaluation to the practical realities of the situation. 

The plan and the procedures for the evaluation should not come as an 
afterthought in the planning process. Attention should be given to the 
evaluative steps to be taken in the early phases of designing and setting 
up the program. 

Although scientific evaluation may appear hopelessly comples and 
burdensome, this should not become a reason for alv/ays retreating into the 
safety of simple check lists and attitude scales for program evaluation. In 
at least some small, limited v/ay a creative and thoughtful attempt should be 
made to determine accurately and reliably the effectiveness of a conference 
and institute program. 



POST - UORICSHOP PLANS 

The workshop participants recommended that the following post-v/orkshop 
activities be instituted: 

1. Preparation of a Workshop report and dissemination of this report to 
the members of the Division. 

2. Conducting a follow-up evaluajion of the v/orkshop. Such an evaluation 
to incorporate suggestions made during the workshop. 

3. A collection of samples of evaluation forms, methods, and procedures 
from members of the Division, and dissemination of those examples of evaluation 

I procedures vjhich represent an application of the evaluation principles 

discussed in the Workshop. 

1 4. Considerable interest was expressed in pursuing further the subject 

of evaluation in the next Pre-Convention Workshop. Such a workshop to be 
\ concerned with some of the more practical aspects of evaluating conference 

and institute activities. 
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By Russell P. Kropp and Coolie Verner 
Florida State Vvhsrsity 



Reprintccl from the Summer 1057 issua of Adult Education, a publication of the 
Adult .Education «\ssociation of the U.S.A.t 743 N« Wabash, Chicago 11* IlL 



fhe scale 



No. Itetfi 

1. Ic M' 3 s one of rho most rewarding experiences I have ever had. 

2. Exactly what 1 w'anred. 

5. I hope we can have another one in the near future. 

4. It provided the kind of experience that I can apply to my own 
situation. 

5. It helped me personally. 

6. It solved some problems fox me. 

7. I think ic served its purpose. 

S. l.c had some merits. 

9. Ic was fair. 

10. It was neither very good nor very poor. 

11. I was mildly disappointed. 

12. Ic was not exactly what I needed. 

13. It was too general. 

14. I am. nor taking any new ideas away. 

15. It didn’t hold my interest:. 

16. It was much too sujjcrfidal, 

17. 1 leave dissatisfied. 

18. Ic was very poorly planned. 

19. I didn't learn a thing. 

20. Ic was a complete waste of time. 



Md. 

1.13 
l.SS 
225 

2.77 
5.40 

4.02 

4.14 

4.96 

5.3 
6.02 

6.78 

6.97 

7.19 
7.45 

8.19 
8.62 
9.29 
9.69 

10.26 

.10.89 



S.I.IL 

.32 

.58 

.77 

,75 
.83 
u59 
.74 
• .42 
.58 
.36 
.37 
.99 
jS7 
j65 
.71 
. .85 

' .72 
.65 
.84 
.31 



NOTES: 

Column 1 is the number of the item 

Column 2 contains the item ^ .... 

Column 3 gives the median value of the item. This is the data used in making the 
score card 

Column .4 $cmi-incerquarcile range (S.I.R.). When tlus value is added to and 
subtracted from the median* it describes the range in the middle half of the values 
given by the Judges fall. 

In reproduciiig the scale for use with groups, only Columns 1 and 2 are used. Ic would 
be iieipful to include instructions to respondents at d;c top of the sheet. 



Scorinm th6 instrument is simplified 
tjr constructing a scoring key winch 
contains the median value for each of 
the items so that the items on the key 
and on the scale can be matched. 
From tins key the scorer can read the 
value of each item tliat has been 
checked on the scale. At this point, 
eitlicr of two metheds can be used to 
determine a final score: the response 
values might be totaled and that figure 
'divided by the number of smtements 
checked; or the median value of the 
sracemenw selected may be computed. 
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Generally, scores obtained from a 
given sec of responses will be similar 
whichever method is employed. In 
cases xvhere a respondent has checked 
extremes at one end of the scale, but 
with the bulk of his checks in the 
middle, then if is likely vhat the aver- 
ge will vary markedly from the 
nedian because the mean or average 
core is more sensitive to extreme 
‘eviadons than is the median. 



The measurement of a nuctirsg is 
equally simple in that the median or 
mean for all the rc3pc:iscs is com- 
puted and this gives a measure of the 
success of an activity on an eleven- 
point scale. Thus, if the medien value 
of all scores is then ic is apparent 
that the reaction of the group to that 
meeting was one of indifference since 
‘*6” is the middle point on the scale. 
As the over-all inc'’’*'n tends coward 
the reaction is increasingly favor- 
able since “1’* is by definition the most 
favorable possible reaction and, con- 
versely, “11” is the least favorable re- 
action. Since the method of scale con- 
struction employed here incorporates 
the nonns in the construction of the 
instrument no others are needed. 



UHlVERSm OF MISSOURI 



EVALUATION FORM 

NoriM of Cenferenca 

1 . DID YOU FIND THIS CONFERENCE USEFUL? 

( ) Ya* ( ) No 

. 2. WHAT DID YOU LIKE BEST ABOUT THIS CONFERENCE? 



3. WHAT DID YOU LIKE LEAST? 



4. WAS THE TIME OF THE YEAR FOR THIS CONFERENCE CONVENIENT? 

( ) Yas { ) No 

5. WOULD ANOTHER TIME BE MORE CONVENIENT? 

( ) Ya* ( ) No 

6 . IF SO, WHEN? 

7. SUGGESTIONS FOR FUTURE CONFERENCES OF THIS NATURE: 
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Evaluation Qaestionnaire 



WASI^GTON 



I^nagemeat by Objectives 
Bromx-joods - Jliarch 27^ 28, 29, 19^9 



f <f) 

GTON UNIVERSITY 

B-3 



Bid the seminar fulfill your escpectations? Hox-r? 



f 



2. Will this seminar experience help you in your job? Hox^? 



3. "^)hat subject was most interesting to you? ^/Jhy? 



k* “^tet subject vjas least Interesting to you? VJhy? 



i 



Was subject matter omitted X'jhich you Xiiould have liked included in the seminar? 
(If so, please list subjects*) 



! 



6* Please list suggestions x-jhich v?ould have made this seminar more meaningful 
to you in relation to your job. 



b. 
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COMPLETE AFTER CONFERENCE 



Participant Opinionairo 



B-4 



Nebraska Center for Continuing Education 
University of Nebraska 
Lincoln. Nebraska 



Now Uiat thii; (^qwfcrence is drawing to a close, wc are certain that you have some reactions as to what parts have been 
laost valuable to you and what parts might have been diflorent. This form is designed to make it easy for you to pass 
t'lcs.e rocictions ajong to the conference planners. It is important that every participant complete and return the opinion- 
a Ire, so that the- reactions of the total group will be reflected. 

7he queslio;os are designed to make it easier for you to express your reactions. If they do not provide sufficient op- 
portunity, please write your comments in your own words. You do not need to indicate your name. 



PLEASE. RETURN THIS COMPLETED FORM 
TO THE CONFERENCE REGISTRATION DESK! 
BEIFOBE YOU ^EAVE THE CONFERENCE 






1 ( ) 



1. What iit tl;.c main way that you first heard about this conference? (check one) 

Received a brochure 

Saw a nev/spaper article 2 ( ) 

Through an organization I belong to 3 ( ) 

Newspaper advertisement 4 ( ) 

Other 5 ( ) 

(Sp«cUy) 

2. Did you enough information about this conference before you arrived? 

Yes 

No 

3. (If no) What else would you like to have known about? 



U ) 
2 ( ) 



) 



) 



) 



) 



) 



) 



4. There arc many parts of a Conference experience that can either contribute to your satisfac- 
tion or detract from it. For each of the following, would you let us know how satisfied you’ve 
been. 

a. meals 

Really outstanding 1 ( 

Very satisfactory 2 ( 

Just acceptable 3 ( 

Needs improvement 4 ( 

b. hotel rooms 

Really outstanding 1 ( 

Very satisfactory 2 ( 

Just acceptable 3 ( 

Needs improvement 4 ( 

c. meeting rooms 

Really outstanding I ( 

Very satisfactory ' 2 ( 

Just acceptable 3 ( 

Need.s improvement 4 ( 

d. other facilities or services 

Really outstanding 1 ( 

Very satisfactory 2 ( 

Just acceptable 3 ( 

Needs improvement 4 ( 



) 



) 



) 



) 



) 



) 



) 



) 



(If you have checked ’’needs improvement" for any of the above, please note below any sug- 
gestions ycu may have.) 



o 

ERIC 



DO NOT 
WRITE 



40 






( )42 
( ) 43 



44 



45 



46 



47 



mum 



mmm 






-r II- - 












TS" 



m 



j. 



Would you describe the one or tv/o most valuable ideas that you received from attending this 
Conferenci? ^ ^ 





p. Afi far as 3 ou’rc concerned, what would have most improved this conference? 



7- Vniich one of these phrases best states how close this conference was to your interests and 
baclcgrou»|l? 

a. It w«.s 'ivay over my head 1 ( ) 

b. I uncloriitood almost everything but the conference missed my main interests 2 ( ) 

c. It dealt with my main interests in an understandable and interesting way 3 ( ) 

d. It WC.3 too basic, few if any new ideas 4 ( ) 



Which onQ of the following statements comes closest to stating your general reaction to the 
total Conference? 



The most valuable educational experience of my life 

An outstanding program, I received much from it 

Many parts were valuable, others not very 

1 gained something from attending but less than I expected 
It was almost a complete waste of time 



(Specify) 



Other. 



6 ( 



9. After this Conference is over, is there anything related to the Conference topics that you 
would like to know more about or to study further? 



Yes 

No 




10. (If yes) What specifically would you like to study? 



11. (If yes) How would you like to do so? 



Study on my own 

Attend a class that meets weekly, 

Attend another Conference 

Take a course by correspondence.., 
Join a local discussion group 



(Specify) 



Other, 



1 ( 
2 ( 




If you have further comments on the Conference, please write them in your own words. Leave 
the completed form at the Conference registration desk, 



rorm 0,‘lil 



DO NOT 
V/xUlE 
( )48 

( ) « 

( ) 50 ■ 

( ) 51 

( ) 52 
( ) 53 
( )54 



SS 



56 



57 



( ) 63 
( )69 



60 



N2 ■ 1877 



r 



O 

ERIC 



Uim'lDRfJITY OF HICHIuAr 



POFit - Meetln(^ Reaction 

(please check (>/) appropriate point on continuum) 
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1- Considering the meeting as a whole^ how saticfled are you with 
this conference session? 



Highly 
Dissatisfied 



rn 1 r~T 



7 



8 



10 



11 



Highly 

Satisfied 



2. How satisfied are you with the decisions or conclusions reached 
in this conference? 



12 3 4 5 6 1 


^ 8 9 10-11 


1 1 


1 1 


1 ^ 1 


r 




! 


rn 


1 1 





■ Highly 
Dissatisfied 



Highly 
Satisfied 



3* How satisfied are you v/ith the part you played in this conference? 



5 



6 

“r 



7 



8 



10 



11 



Highly ■ 
Dissatisfied 



Highly 

Satisfied 



;4;. How satisfied are you the leader in this conference? . 
2 .. 3 4.5 6 7 8 9 10 . 11 



Highly 
Slseatlsfled 



T~T 



Highly 
Satisfied 



5- ^Did the leader (check) 
a* talk too much 



"b, talk too little 



c. talk about right number* of times 



6. Did your group reflect teamwork (v/e -feeling) or v/as dls- 
Jolntedneas (X-feellJag) predominate? 



4 



5 



8 



10 



11 



’"I-Peelljag^^ 

7» ComiTients 



T 



”We Feeling** 



a. 

b, 

c; 



3)0 not s:!rn your nny’e. 






idstSiam 
























1 

'( 

■1 

;j 

i 

;] 



INDIANA UNIVERSITY 
CONFERENCE BUREAU 




CONFERENCE FOLLOW-UP FORM 

?■ 

R 

Name of Conference; Conf. # 

Dates Held: 1 

^ I 

Please complete this form and return it in the envelope provided to the CONFERENCE BUREAU* UNION BUILDING* 

INDIANA UNIVERSITY* BLOOMINGTON* INDIANA. An early response will be apprecUted. 

1. What was the actual registration of this conference? 

If you did not have a registration* what was the estimated anendance ? 

2. Of those registered, how many were from: 

This campus and Bloomington ? 

Indiana* including local people ? 

Region of Indiana* Illinois* Kentucky* Michigan and Ohio? 

The test of the United States? 

Foreign countries ? 

3. Of those registered, how many were High School Studenu from: 

Indiana* including local people ? 

The rest of the United Sutes? 




4, Was University credit given to any participants ? 

5, Were University certificates iuued to any participants ? U niversit y O the r 

6, Were facilities and accommodations satisfactory? (If not* please explain). 



7. Were there any last minute difficulties or prearranged details that were not uken cate of? (If there were* please 
explain). 



8. Do you have any suggestions for the improvement of the handling of conferences by the University in general and 
the Conference Bureau in particular? 



This report made by ; Date; C BG211 






o 

ERIC 





3. Overall Instruction Excellent 



Good 



Fair 



Poor 



Specific* Instruction - Comments: 



4. Pliyaical Facilities Excellent 



Good 



Fair 



Poor 



Comments : 



o 

ERIC 












1 






5 
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5. Was fche material generally presented at the correct level for this group? 

! , 

. Comments : ’ ' ■ • ' ’ ' 

i ^ . ’ * ' ‘ • 

f ■■ ^ ; — •- 

\ . ■• . 

1 _ ' • ■ ■ 



i 

i 6. Would you reconunend that your organization send other people to a course 

1 of this kind in the future? 

i 

Yes No 



Comments: 



SHORT COURSE EVALUATION 



7. Overall value of the course to you. Please state in your own Words,. 



8* Suggestions for iraprovement of the course. 










I 

i 







r 



i] 

‘li 




9. l“jh.cre did you first learn of this course? 
Newspaper 

Kagazine, journals, etc. 

Word of mouth 

Brochure _______ 

Company Personnel Department ■ 

Other 




maammmmarn^^ 






■*1 ' 



COMMERCIAL CREDIT COMPANY 
MANAGEMENT DEVELOPMENT SEMINAR 
DECEMBER 10-15, 1967 



UNIVERSITY OF I4ARYLAl'iD 
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Program Evaluation 




i 

1 

ii 

1 



Column 1; Please rate each subject (session) of the program in terms of its value , 
importance and helpfulness to you as a manager. . Rate according to the following 
scale: 



1 

2 

3 

4 

5 



great positive and personal value to me; 
substantial positive and personal value to me; 
some positive and personal value to me; 
little positive and personal value to me; 
no positive and personal value to me. 



WRITE ONE OF THESE NUMBERS IN COLUMN 1 FOR EACH SUBJECT. 



Column 2 ; Please rank the subjects (sessions) in terms of their value , importance 
and helpfulness . Place the following symbols on the line of the appropriate subject; 



+3 
-1 
-2 
-3 

WRITE ALL SIX OF THESE SYMBOLS (+1, -2, etc.) IN COLUMN 2 FOR THE 
CORRESPONDING SUBJECT. 



the most valuable (etc.) subject (session); 

the second most va^able (etc.); 

the third most valuable (etc.); 

the least valuable (etc.) subject (session); 

the second least valuable (etc.); 

the third least valuable (etc.). 




Column 1 Column 2 



Subjects (Instructor) Ranking 



Management and Organization Theory (Tosi) 








Management By Objectives (Tosi) 






Planning (Carroll) 


* 




Problem-Solving (McCain) 






Introduction to the Computer (Sprague) 






The Computer's Role in CCC Operations; Present 
and Future (Armstrong) 






Delegating to Subordinates (Rausch) 






Decision-Making (Rausch) 






Simulated Decision-Making (Rausch) 






Interpersonal Communication in the Organization (McCain) 






Understanding Human Behavior (Waldrop) 






Motivating Subordinates (Waldrop) 






Financial Management (Olson) 






Principles of Supervisory Training (Bartlett) 






Supervisory Training at CCC (Arrildt, McCain) 






Innovations in Personnel Management (Ivancevich) 






The Effective Manager (McCain) 











































F 



i 

\ I 







i 



j 

1 



M 






Please circle one response number for each of these items. 
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1. The experience of attending this seminar has been of. . . 

1 “ great positive and personal value to me; 

2 - substantial positive and personal value to me; 

3 - some positive and personal value to me; 

4 “ little positive and personal value to me; 

5 - no positive and personal value to me. 

2. The sessions of this seminar have acquainted me with. , . 



1 - a great many new ideas and points of view; 

2 - a substantial number of new ideas and points of view; 

3 - some new ideas and points of view; 

4 -• very few new ideas and points of view; 

5 - no new ideas and points of view. 



3. 



I think that specific information from the reading materials was. . . 



1 - extremely useful; 

2 “ quite useful; 

3 - of some use; 

4 - of very little use; 

5 - of no use at all. 



In terms of personal changes in your practice of management, this seminar 
will probably produce. . . 

1 - a great many new practices; 

2 “ a substantial number of new practices; 

3 - some new practices; 

4 “ very few new practices; 

5 - no new practices. 

In terms of changes in the parent company (if you are wfth the parent company) 
or your subsidiary, this seminar will probably produce. . . 

1 “ a great many new practices; 

2 “ a substantial number of new practices; 

3 - some new practices; 

4 -• very few new practices; 

5 - no new practices . 



o 
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ij 

i 

n 






I 

I 
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r‘ 
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1 



i 



i 



i 



\ 



u 



I ’ 

f I 




h 



f 



i 

I 
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Durinf; the. Second Annual .Industrial Ventilation and Air Pollution Conference, 
you have been exposed to thirteen General oouuionu, pl-iu tv/olve houro of 
clay 13 room design work. 

1. Vmi you indicate belov/: 

(a) The three rhoot valuable Oonex*al SecMiorin- 

1 . 

2 . 

3 . 

0>) Sessions which you feel could have been omitted- 

1 . 

2 . 

3 . 

(c) Sessions or subject areas which should iio.ve been added- 

1 . 

2 . 

3 . 

(d) Do you feel that twelve hours in the design sections is enough or 
should we plan to have fifteen? 

T welve hours is enough • Plan for fifteen hours 

2. Do you feel that the level of the conference waix: 

(a) Too high (b) Just about right (c) Too elementary 

3* How would you rate your general treatment on campus and in the conferences 
(a) Excellent (b) Good (c) Poor (d) Hemarks; 



4* If yoii were a member of the Planning Committee planning for next year's 
program: 

(a) Would you expand the air pollution session to another full day? 

Yes No 

w What subjects would you add? 

(c) What subjects would you delete? 

(d) Would you encourage evening classes EACH night? 

^Yes ^No 

(e) Do you have any speakers or instructors that you v/ould I’ecommend an 
part of the staff for a future conference? 






i 

i 



i 



4 




1 



] 



1 

I 

I 





















UNIVERSITY OP MICHIGAN 
PARTICIPANTS EVALUATION SHEET 



1. What were your objectives for attending this conference? 



2. To what extent have these objectives been realized? 



Not at 
All 



Very 

Little 



Partially 

Realized 



Fully 

Realized 
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3. Please evaluate the sessions by responding to the following items: 
A, Research Papers 



No 

Value 



Some 

Value 



Much 

Value 



Paper No. 1 

(System Analysis) 

Paper No. 2 

(Motivations and Attitudes) 

Paper No. 3 

(Input and Skill Development) 

Paper No. 4 

(The Role of Alcohol) 



Paper No. 5 



Paper No. 6 . . . . 

(Legal Sanctions) 



m • m • • • 



• ossesssesse 



Paper No. 7 

(Knowledge Utilization) 

B. Individual Presentations 



1 

0 








A 


5 


1 






■ 


10 


1 


1 


A- 


. _ t 


» 


1 




f 






J 


0 










5 










10 


f 


• 


i 


1 


A 


1 





t 






1 . 


0 










5 










10 


1 


1 




A 


A 


1 




1 




A 


1 


0 










5 










10 


1 


i 


• 


1 


t 


1 .. 




1 


f 




JL^ 


0 










5 










10 


1 


A 


i 


A 




1 


i 


t 


t 


A 


1 


0 










5 










10 


1 


1 


a 


A 


1 


I 


1 


1 


• 


■ 


II 


0 










5 




• 






10 


I 


1 


A 


A 


1 . 


1 


A 






a 


-J « 


0 










5 










10 


L- 


i 




A . 


L. 


1 




i 


i 


A 


1 



Forum 



iO 
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D. Panel Discussion 

(Check the panel that you participated with) 



No 

Value 



B-14 

Some Much 

Value Value 



j I Education 
ri Legislation 
r~| Licensing 
rj Law Enforcement 

□ Man-Machine -Road 

□ Public Information 



1 1 


■ 


i 


1 


1 


1 




i 


,1 


1 


0 








5 










10 


L 1 


1 


- i 




f 


. t 


.J 


1 


I 


1 


0 








5 










10 


1 ( 


t 


1 


1 


1 


1 


1 


i 


f 


1 


0 








5 










10 


1 1 


1 


i 


1 


1 


. -i 


1 


t 


1 


1 


0 




4 




5 










10 


1 1 


t 


- i 


. in. 


J 


t 


i 


■ 


1 


1 


0 








5 










10 


I 1 


1 


1 


1 


1 


• 


1.. 


i 


-J - 


i; 


0 








5 
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4, What part of the program was the most significant for you. 



5. What part of the program was the least significant for you. 
■ 6. Suggestions for next year*s Symposium. 



I ■ 

¥ 

Your principal employment: 

□ University or Research institution 

I D Manufacturing 
□ Insurance 
□ Government 



Q Media 
n Safety 
n Other 



I 
















1 



i 



i 

? 

n 
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INSTITUTE FOR CITY MANAGERS 
University of Colorado 
May 16-10, 1963 

EVALUATION 



Please help us to plan future institutes by carefully appraising this 
one. Your candid and franlc judguents will be of great value. 

PART I 



Indicate your appraisal of each session by circling the appropriate nuDber. 





Of no 
value 


Of some 
vn lue 


Of great 
value 






THURSDAY 

The Expanded ICMA Prograu; 
a Progress Report 


1 


2 


3 


4 


5 


6 






The Teaching of Local 
Government in High School, etc. 


1 


2 


3 


4 


5 


6 






FRIDAY 

Rcx 7 Can Professional Standards in 
City Management Be Raised? 


1 


2 


3 


4 


5 


6 






Emerging Problems in Environmental 
Health 


1 


2 


3 


4 


5 


6 






The City Manager of the Future - 
An Optimistic View 


1 


2 


3 


4 


5 


6 






SATURDAY 

Critical Issues Related to Incorpora- 
tion, Annexation and Special Districts 


1 


2 


3 


4 


5 


6 




• 


City Managers' Clinic 


1 


2 


3 


4 


5 


6 






The Use and Abuse of Internes 
and Administrative Asoistantn 


1 


2 


3 


4 


5 


6 




• 


PART 


11 
















Indicate your appraisal of the following 
number . 


items by circling an appropriate 




Poor 




Fair 




Good 




Excellent 


1. Choice of program subjects 


1 


2 


3 


4 


5 


6 


7 


8 


2. Choice of speakers 


1 


2 


3 


4 


5 


6 


7 


8 


3. Choice of methods of presentation 


1 


2 


3 


4 


5 


6 


7 


3 


4. Opportunity to participate 


1 


2 


3 


4 


5 


6 


7 


8 



4 



: 

1 






I 






m 

\i 



er|c 



mmmm 



mmm 



immm 
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5. 


Physical arrangements for 
institute . 


Poor 
1 2 


Fair 
3 4 


Good 

5 


6 


Excellent 
7 C 




Advance Information about 
Institute . 


1 


2 


3 


4 


5 


6 


7 C 


7. 


Your evaluation of the over-all 
program. 


1 


2 


3 


4 


5 


6 


7 C 



PART III 



Yes Ko Remarks 

TJos the program practical? _____ ___ 

Did you gain much from your Infortoal 

contacts during the Institute? ______ _____ 

Do you feel you helped anyone with 

his problems? ___ ___ 

T7111 you do anything differently back 

on the Job as a result of this 

Insititute? _____ ____ 

Should the Institute be repeated 

annually? _____ ___ 



PART IV 

!7hat subjects should be discussed at a future institute? 

1 . 

2 . 

3. 

Please make any other suggestions and comments t/hich you feel may 
help us improve future institutes. Use other side if necessary. 



r 






O 

ERIC 
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II. V/hat subject areas not covered should be included in future seminars? 



III. If this seminar were offered next year, what would be your recommendations as to 
making it more valuable for you or your co-workers? 



IV. Would certification of such a course with The National Executive Housekeepers 
Association, Inc. be valuable in your job? YES NO 



V. Your comments (good or bad) on housing, food (where you were housed), etc. 



THANK YOU 
















r 
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TAX AUDITORS SEKINAR 

University of Colorado, Boulder, Colorado 
Scralnar dates ______ 






I 



EVALUATION 

(No signatures please) 




I 



j 



i 



O 

ERIC 
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PART I 

We are interested in a meaningful appraisal of this Seminar. Your candid 

judgments are solicited in completing this form. 

Evaluation should be based on what was accomplished in relation to what 

was to be accomplished. How well did the Seminar achieve the stated 

objectives: 

Very Koder- 

Objectives Well Well ately Poorly 

1. To sharpen the skills and perception 

required of Tax Auditors — — . 

2* To develop style and techniques which 
will improve performance and further 
understanding and good will toward 
th2 program and its administration 

3. To stimulate the professional devel- 
opment of selected personnel to 
maintain administrative excellence 
within the agency 

4. Review and update knowledge of 
auditing objectives, principles 
and techniques 

5. Adapt basic auditing techniques to 
use with electronic data processing 
systems 

6. Develop ease and clarity in writing 
complete, concise reports 

7. Gain insight into the psychology of 
communication for better inter- 
viewing and public relations 

8. Review concepts of administrative 
law as they relate to the' agency, 
the duties and limitations of 
auditors 







PART II 
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Based on the follovring Reaction Scale, how 
satisfied were you with each of the courses 
listed to the right? 

• 

5. Completely satisfied 

A. Satisfied 
3. Acceptable 
2. Slightly dissatisfied 
1. Dissatisfied 

Each of the above numbers corresponds to a 
degree of satisfaction or dissatisfaction. 
Write the number in the square beneath each 
subject Xi^hlch most nearly reflects your 
satisfaction for each item listed under 
’’Increased Information or Skills" and 
"Quality of Instructional Method." 

Increased Information or Skills covered in 
course through; 

A, Broader view of and new insights 
Into subject matter 

B, Specific information helpful to you 

C, Better understanding of basic 
causes of problems 

D, Identity of steps involved in 
logical approach to problem 
solution 

E, Appreciation of principles and 
their application to everyday 
problems 



TOTAL 

Quality of Instructional Method Demonstrated 
< by: 

A. Effective presentation of materials 

B. Developing class receptivencss 

C. Evoking animated response 

D. Showing mastery of teaching 
techniques 

E. Reflecting broad knowledge of 
subject matter 

TOTAL 

USE REVERSE SIDE FOR COMMENTS 



















PART III 

Please read all of the following statements and check only those which 
best describe how you feel about this Seminar. 

It was a richly rewar .'ing experience. 

I will do some things differently as a result of this Seminar. 

I gained new knowledge about and insights into the subjects which 
were covered. 

The informal conversations with my colleagues benefited me much. 

I helped some of my colleagues with their problems. 

The Seminar helped me realize the importance of continuing education. 
The Instruction was too general. 

I was not really well satisfied with this experience; 

I saw no relation between this Seminar and my everyday job. 

We covered too much material in the time available, 

I didn't learn anything. 
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PART IV 

How satisfied were you with the following: 

Very 

Satisfied 



Physical arrangements 
Meals 

Instructional materials 
Instructors 

Organization of the Seminar 
Choice (/£ .iubjects 
Opportunity to participate 
Methods of instruction 
Over-all program 



1 

1 

1 

1 

1 

1 

1 

1 

1 



2 

2 

2 

2 

2 

2 

2 

2 

2 



Moderately 

Satisfied 



3 

3 

3 

3 

3 

3 

3 

3 

3 



4 

4 

4 

4 

4 

4 

4 

4 

4 



Dis- 

satisfied 



5 

5 

.5 

5 

5 

5 

5 

5 

5 



6 

6 

6 

/ 

6 

6 

6 

6 

6 

6 




m 



1 






PART V 




If another seminar of this nature is held, what subjects should be included 
for study?/ (Be specific) 






Please give us the benefit of other suggestions which would improve a 
future serainar. 



Thank you for your cooperation 












wmmmmm 







NATIONAL WORKSHOP ON CONFERENCE PLANNING 



University of Maryland 
January 7-12, 1968 



Part I: Knowledge Acquired 



This Workshop was designed to incarease your understanding of 
conference planning. In the spaces below each session, briefly 
indicate the specific principle s,- attitude s , techniques and/or 
practices which represent a significant learning experience, i.e. , 
what wa«! learned that can be useful to you as a conference planner. 

Make a distinction between (1) information which you did not know 
of before this Workshop, and (2) information which clarified, amplified 
or simplified your thinking. 

Although the format encourages you to be brief and to the point, 
do not be general. Avoid simply saying, "I learned more about setting 
conference objectives." Relate the primary information you picked up 
in Buskey's session. 
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COMPLETELY NEW INFORMATION 



CLARIFIED, AMPLIFIED, SIMPLIFIED 
INFORMATION 



Attitudes Toward Conference Planning - Buskey 



Roles of the Conference Center and Its Staff - Deppe 



An Overview of A Systematic Program Planning Process - Buskey 



\ 



The Role of Communication in the Planning Process - McCain 






Page 3 



B>2$ 



COMPLETELY NEW INFORMATION 



CLARIFIED, AMPLIFIED, SIMPLIFIED 
INFORMATION 



The Effective Coordinator; Personal Administrative Skills 



Adult Learning - Aker 



I 



Group Interaction for Learning and Development - McCain & Aker 



Identification and Appraisal of Needs. Problems & Program Ideas - Deppe 



o 

ERIC 



Ea 
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COMPLETELY NEW INFORMATION 



Case Studies on Problem Identification (Interviews) - Staff 



CLARIFIED, AMPLIFIED, SIMPLIFIED 
INFORMATION 



Selection of Goals & Objectives - Buskev 



Structure and Design of Programs - Buskev 



The Residential Conference Center - Buskev 



f 
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COMPLETELY NEW INFORMATION 



CLARIFIED, AMPLIFIED, SIMPLIFIED 
INFORMATION 



Operating Conference Programs - Deppe 



Workshop Sessions ~ To Develop A Program ~ Staff 



The Effective Coordinator; A Critioue of Programs Developed by Groups Staff 



Evaluation of Short Term Educational Programs - Staff 
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Part II: General Evaluation 



Please wpite vour answers to the following questions . If you need additional space for 
any itfem’, use the back of a page, but indicate the question number you are responding 
to. '' 



1, What is your opinion about the length (number of days) and schedule (8:30 - 5:00; 
evening sessions; coffee, lunch and dinner breaks) of the Workshop? 



3. 



2. In considering the Workshop In its entirety, what opinions do you have about 
Its practical value? 



What changes would you make In the program If It were to be conducted again 
for another group of conference planners? Be specific! (Complete your answer 
on the reverse side of this page.) 



mm 
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It was the responsibility of John Buskey as Workshop Chairman to plan the 
program, select instructors, orient the staff, and conduct evaluations. 
Please evaluate him in terms of his fulfillment of these responsibilities. 



In terms of your personal effort and drive to get the most out of what was 
provided during the Workshop, evaluate yourself. (Check one) 

excellent 

good 

average 

below average 

poor 



What were the strengths of the Workshop? 



What were the weaknesses of the Workshop? 



What are your opinions about the reading materials and assignments for the 
Workshop? 
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9. Please read all of the following statements. Then, circle the letter preceding 
all those that state how you feel about the Workshop as a whole. 

a. It was one of the most rewarding experiences I have ever had. 

b. Exactly what I wanted. 

c. I hope we have another one In the near future. 

d. It provided the kind of experience that I can apply to my own situation. 

e. It helped me personally. 

f. It solved some problems for me. 

g. I think It served Its purpose. 

h. It had some merits. 

1. It was fair. 

j. It was neither very good nor very poor. 

k. I was mildly disappointed. 

l. It was not exactly what I wanted. 

m. It was too general. 

n. lam not taking any new Ideas away. 

o. It didn't hold my Interest. 

p. It was much too superficial. 

q. I leave dissatisfied. 

r. It was very poorly handled. 

s. I didn't learn a thing. 

t. It was a complete waste of time. 

10. In one sentence summarize your current thinking about the Workshop. 



m&m 
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Part HI; Instructor Evaluation 



As you recollect each session of the Workshop, mark your ipipression regarding the 
session on the two items below. To indicate your Impression circle the proper 
number. 



How Important was the subject 
or discussion topic for you? 

Column A 



Most important 5 

Very Important 4 

Some importance 3 

Little importance 2 

No importance 1 



Did the presentation have clear 
and to the point explanations? 

Column B 



Exceptional 5 

Very good 4 

Good — 3 

Fair 2 

Poor .. 



Session (Instructor) 


Rating 
Column A 


Rating 
Column B 


Attitudes Toward Conference Planning (Buskey) 


5 4 3 2 1 


5 4 3 2 1 


Roles of Conference Center and Staff (Deppe) 


5 4 3 2 1. 


• 54321 


Program Planning Process (Buskey) 


5 4 3 2 1 


5 4 3 2 1 


Communication In Planning Process (McCain) 


5 4 3 2 1 


5 4 3 2 1 


Adult Learning (Aker) 


5 4 3 2 1 


5 4 3 2 1 


Group Interaction for Learning and 






Development (McCain-Aker) 


5 4 3 2 1 


5 4 3 2 1 


Identification and Appraisal of Needs, etc. 






(Deppe) 


5 4 3 2 1 


5 4 3 2 1 


Case Studies; Problem Identification (Staff) 


5 4 3 2 1 


5 4 3 2 1 


Selection of Goals and Objectlv'Ss (Buskey) 


5 4 3 2 1 


5 4 3 2 1 


Structure and Design of Programs (Buskey) 


5 4 3 2 1 


5 4 3 2 1 


Residential Conference Centers (Buskey) 


5 4 3 2 1 


5 4 3 2 1 


Operating Conference Programs (Deppe) 


5 4 3 2 1 


5 4 3 2 1 


Workshop Sessions: To Develop a Program 






(Staff) 


5 4 3 2 1 


5 4 3 2 1 


The Effective Coordinator; A Critique of 






Programs Developed by Groups (Staff) 


5 4 3 2 1 


5 4 3 2 1 


Evaluation (Staff) 


5 4 3 2 1 


5 4 3 2 1 



o 
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I - WORKSHOP FOR MAJNPOWER TRAINING STAFF 

i 

I July 29 - August 16, 1966 

EVALUATION FORM 







Note: Would you please sign this evaluation so that its 

meaningfUlness can be interpreted in the light of 
your entering behaviour. 



1 



I' 

I; 

51 
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Training" of »-grain6rs Workshop 
2Jvaluation Form 






I. IN m JOB, I HAVE PLAMED 

TRAINING PROGRAMS, INCLUDING: YesiNo 



Mv knowledge has increased 



1. determining training needs “ 

of participants 

a. from their viewpoint 

b* from their supervisor's 
viewpoint 

c. from my knowledge of the 
field and of what they 
need to know 



2. deciding on objectives 
for the program 



3. deciding how the 

participants* learning 
is to be evaluated 



h. 



selecting and sequencing 
learning activities (what 
should be the subject 
mater and what methods 
and techniques would be 
best) 



5. planning with instructors 
and resource persons re 
their participation 



6 . 



looking after administrative 
details in connection with 
plans for the program. . . . ^ 



II. IN MY JOB I HAVE CONDUCTED 
TRAINING PROGRAMS, INCLUDING: 

1. serving as "instructor” 
or ’’director" myself 



2. doing some instructing 
but mainly coordinating 
sessions conducted by 
others 



3. serving as administrator, 
only, while others are 
responsible for the 
conduct of the sessions... 



Insignifi" 

cantly 



(Moderately j 



Knowledge is 
Pertinent 
to my job 



Extensively Yes No 



'ERIC 
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II. 



III. WITH RESPECT TO THE FOLLOWING 
METHODS AND TECITOQUES , 



I have used thi- following 
in nqy work 



1. conference 



2. institute 



3. class 



4. workshop 



5. buzz group 



6. discussion group 



7. role-play 



8. case study 



9. case incident 



10. demonstration 



11. sensitivity training 



IV. WITH RESPECT TO THE FOLLOWIN 
INSTRUCTIONAL AIDS, 



I have used the following 
in Efiy work 



1. Flip chart 



2. Chalk-board 



3. Film (moving picture )_ 

4. Film str5.ps or slides 



5. Tape recorder^ 

6. Video-tape 



7. Flannel-board 



Yes 



No 



J 
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My Knowledge Has Increased 



Insignificantly 



Moderatelyl Extensively 



Knowledge 
. is Pertiner 
to my job 






Yes! Nc 









III. 
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V. Please comment on any of the following topics about which you feel strongly with 
regard to how they v;ere applied to this course: 

1. opportunity to practice 6. topics developed 

2* reinforcement y, appropriateness of selected resources 

3» knowledge of results 8, appropriateness of selected 

educational techniques 

4. common interests or needs 

of participants* identified 9* each session outlined and various 

responsibilities carried out 

5* goals set for the learning 

activity 10. evaluation planned 







r,U fr^. 



IV. 
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VI .Was the workshop method as used in this course the best method? 
Please comment 



Further Comments: 




1. Re length of the Work^^hop: 



6-37 

Vi 



a. Biree veeks vas about right. 

b. Two weeks would be sufficient if time could be saved by cutting 
down on certain areas, such as: 



m 

2. Would you have liked more assigned reading during the worksho p Y es; N o* 
Would you have liked more guidance in your reading •* 0*g. a ’’basic” list of 
selected chapters in about 5 books? Y es; No. 

3* Was the amount of free time: (please check) 

^ j 

Too little about right Too much 

« 

. 4* Was the balance of ^time with guest lecturers 

(time in other Workshop activities 

about ri^t, or would you have preferred (check one) 

more time with guest lecturers 

less time with guest lecturers 



o 
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Scfliimr for Purchasing Agents 
Vfeshington University 
Fall 196 ? 



Particir?ant Bvaluatioa 



Kio Pro-D Committea and Washington University would appreciate yow 
candid opinions about the follovring aspects of the 19o? “Management of the 
Purchasing Func‘*4on‘' saainar. 

1, The length of each session (2-| hours) ms - 

Too long (I suggests 
*""'**'*** About right 
Too short (I suggests 



2, The nuniber of sessions (6) ms - 



3 * 



Too many (I suggest: 
About ri^t 

Too fm CX suggeMis 

« 



The advance material publicizin,5 the program (dM J 
giv6 a fair Indioaliioji of what tho saswinar wouXd ba llic6» 



(did not 
Speeifioallyf 



my objootions ares 



4# Th© number of paHioipants was •• 

Too large (I suggests 

About right 

Too few (I suggests 

5» The -pliysical facilities were •• 

. . Adequate 
^ '' "Z Inadequate 

6« The amount of advanced reading assignments was 

^ Too heavy (Sessions: 

"" Keasonablo 
'' Tco light (Sessions 5 
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7p As to teaching methods, X would ;pr©f0r ^ 

The methods as used, more or less# 

. , , J4ore lectures, less case discussion# 

■ More case discussion, less lectures. 

iiore use of small group discussions-and-reports. 
Other (I suggest: 



6# The seminar stressed the principles of general management, forecasting, 
managerial planning, and managerial control. Examples and case materials 
from purchasing were used; however, it was not the priinary objective of 
the seminar to studj^ paHicular ix>licies and procedures of purchasing. 

. I X'Tas satisfied td.th both the general objective of the saninar 
and the general topics covered each week. 

I was satisfied vdth the general objective of the seminar. Never- 
theless, some more time should have been spent on the following 
aspects of purchasings 



I tras dissatisfied with the general objective of the seminar. Tlie 
primary stress should l^iave been upon the following purchasing policies 
and procedures; 



X was dissatisfied with the general objective of the seminar. A 
seminar such as this should select one or at most two specific topics 
and devote the entire time to their analysis. I would suggest these 
specific topics as the one or two; 



er|c 
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9* Evaluate each of the si3c sessions as "verj>‘ good", "satisfactory", or 
"unsatisfactory" vdth respect to the foUotdng three cbaracteris'tics: 

Very l^isatis- 

Good Satisfactor y factoid 

a. !0ducational value of the session* s 
subject matter: 

Session 1 

II 
W 
II 

B* Teaching methods used: 

Session 1 
" 2 

» 3 

n 4 

" 5 

" 6 

Ci 'Quality of the instruction: 

Session 1 
" 2 

.1 3 

» 

5 

6 






n 



lOi I had it to do over again, I (woifLd (would not 

this seminar* 



) enroll In 



Hi I (would 



(would not ) suggest to my subordinates and/or coHoagu,s, 



in my business or the Purchasing jVgents* Association that they enroll 
in this seminar next year. 



12i Other suggestions and «cxnments: 
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CONFIDENTIAL EVALQATION OF PPT SUPERVISORY 
DEVELOPMENT PROGRAM 

(Give us your honest and frank opinion about both the good and the bad of 
the course.) 

1. Following is an outline of the material covered in the PPT Supervisory 
Program. Check the appropriate blanks for each of these subjects. 

Change 

Keep As Is But Keep Drop 
Problem Solving and Decision Making — _ — — . 

Nichols Tape on Effective Listening 

Blueprint Reading . 

Discussion of Specifications 

Supervisor's Planning Job « 

CPM and PERT 

Safety «_« 

Job Problems Presented by Students ------- — 

Economics of the Industry — — — — — — 

Cost Control • -««« 

Other Controls— Materials, Supply Tools, 

GtC « — — ' 

Face to Face Communications _ — — — — — 

Public Relations — — — — — . 

International and Historical Comparisons 

of Management . — — — — 

Individual Differences in People . 

Needs and Goals of People — _ 

Personality Types — — 

Sociology of People . — — — — — 

Leadership and Authority __ - — — 

COMMENTS: 



, ^ 

2. What other things should be included in the program? (Don't worry about 
the number of weeks involved at this time.) 
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A discussion of labor laws. 


Yes 


No 


An introduction to estimating. 


Yes . 


No 


Effective material handling and 






storage on construction jobs. 


Yes 


No 



Other sessions you think should 
be added. 



3. Should there be more technical sessions on job know how? Yes No 

4. Should there be more speakers from Management? Yes No 

5. Do you really think you have profited from the program? Yes No 

Why ? ; 



6 * Do you think the length of the course should be reduced? Yes No 
If so, what would be the ideal number of weeks? , 

7. If the course is reduced to 20 weeks, should there be a break in the middle? 
Yes No . 

8e The sessions were held from 7:00 p.m. to 9:30 p.m*— do you think thi$ shoulo 
be changed? Yes No . If so, at what hours should the program 

be offered? 

9. T-Jhat nights of the week do you think best? ' 

10. If you had it all to do over again v/ould you have taken this Program? 

Yes No 

11. Would you, at somo time in the future, be interested in a short refresher 

course of 6 to 8 sessions? Yes No 

12 o Would you' recommend this course to a friend, fellow employee with 
supervisory potential or to another supervisor? Yes No 

13. Should there have been more reading assignments? Yes No 
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